WHAT IS CLAIMED IS: 

1 . A system f^f tracking at least one object in at least one sequential 
image, comprising: 

a general purjbose computing device; and 

a computer program comprising program modules executable by 
the computing device, wherein the computing device is directed by the program 
modules of the computer program to: 

(a) generate\a state estimate defining probabilistic 
configurations of each object for each sequential image; 

(b) generate observations of pixel color for each sequential 
image; \^ 

(c) automatically learn a color-based object model using the 
state estimate and the observations; and 

(d) automatically track each object using the learned color- 
based model with a color-based tracking function. 



2. The system of claim 1 wherein generating the state estimate 
comprises determining the probabilistic configurations of each object using an 
initial image processing program module. 



3. The system of claim 2 wherein the initial image processing program 
module employs a tracking system comprising a tracking function in combination 
with an object model for probabilistically detecting object configuration 
information. 



4. The system of claim 2 wherein the initial image processing program 
module employs a contour-based tracking function in combination with a contour- 
based object model for probabilistically detecting object configuration information. 
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5. The system of claim 1 wherein generating the observations of pixel 

color comprises collecting pixel color information over the entirety of each image. 

\ 

6. The system of claim 1 wherein generating the observations of pixel 
5 color comprises collecting pi^el color information over specific portions of each 

image. 

7. The system of clairr^B wherein the program module for generating 
the observations of pixel color employs the state estimate to identify specific 

10 relevant regions of each image ove\which pixel color information will be 
collected. 



8. The system of claim 1 wherein generating the observations of pixel 
color comprises automatically generating a first probability distribution function 



fy 1 5 modeled using a first histogram to represent a range of observed pixel colors. 



9. The system of claim 8 wherein the histogram is represented by a 
Dirichlet function. 



UJ 20 10. The system of claim 8 wherein the program module for 

q automatically learning the color-based object model automatically computes a 

second probability distribution function modeled using\a second histogram to 

represent a background for each image. 

25 11. The system of claim 10 where a preliminary ^olor-based model 

represented by a third probability distribution function modeled using a third 
histogram is used to weight the first and second histograms. 

1 2. The system of claim 1 0 wherein the first and second histograms are 
30 automatically weighted in relation to the expected relative areas of object and 
non-object areas, respectively, within each image. 
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13. The systemtof claim 10 wherein automatically learning the color- 
based object model comprises performing a bin-by-bin comparison between the 
first histogram and the second histogram. 



14. The system of claim 13 wherein bins in the first histogram having 
values exceeding corresponding\bins in the second histogram correspond to 
those color ranges representing tl\^ learned color-based object model. 

1 5. A computer-implemented process for generating a color-based 
object model, comprising: \^ 

generating a state estimate defining probabilistic states of an object 
for each of at least one sequential image's; 

generating observations of pixel color for each sequential image; 
and \ 

automatically learning the color^pased object model using the state 
estimates and the observations. 



1 6. The computer-implemented processus claim 1 5, further comprising 
using the learned color-based object model in a tracking system for identifying a 
configuration at least one target object in each sequential image. 

1 7. The computer-implemented process of claim 1 5 wherein a 
confidence measure is associated with the observations of pixel color. 

1 8. The computer-implemented process of claim y wherein the 
observations of pixel color are weighted in proportion to the confidence measure. 

1 9. The computer-implemented process of claim 1 5 wherein the 
observations of pixel color are collected for each entire image. 
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20. The computer-implemented process of claim 1 5 wherein 
observations- of pixel color are collected over specific portions of each image 
wherein the state estimate h\s a probability greater than a minimum threshold 
level. 

\ 

21 . The computer-implemented process of claim 1 5 wherein the 
observations of pixel color are represented by a first probability distribution 
function modeled using a first histogram. 

\ 

22. The computer-implemented process of claim 21 further comprising 
a background image for probabilistically Yepresenting a known fixed state relative 
to each image, and wherein the background image is represented by a second 
probability distribution function modeled usmg a second histogram. 

23. The computer-implemented process of claim 22 further comprising 
a preliminary color-based model for roughly representing each target object is 
represented by a third probability distribution function modeled using a third 
histogram. 

24. The computer-implemented process of claim 21 wherein the first 
and second histograms are scaled in relation to expected relative areas of object 
and non-object areas, respectively, within each image. 

25. The computer-implemented process of claim 24 wherein the first 
and second histogram are weighted in relation to the third histogram. 

26. The computer-implemented process of claim 24 wherein the 
second histogram is subtracted from the first histogram via a bin-by-bin 
comparison between the first and second histogram. 



-44- 



• 4 

27. The comp\iter-implemented process of claim 26 wherein the 
subtraction yields a fourth histogram for representing the learned color-based 
object model. 



28. The computer-implemented process of claim 1 5 wherein generating 
the state estimate comprises p)ocessing each image with an initial object model 



and an initial tracking function. \ 



\ 

\ 

\ 

29. The computer-implemented process of claim 28 wherein the initial 
1 0 object model is iteratively replaced with the learned color-based object model 

and the initial tracking function is replaced with a color-based tracking function to 
improve the accuracy of the learned coloVbased object model. 



30. The computer-implemented prqcess of claim 23 wherein the 
1 5 preliminary color-based model is iteratively replaced with the learned color-based 
object model to improve the accuracy of the lea\ned color-based object model. 



31 . The computer-implemented process of claim 30 wherein generating 
the state estimate comprises processing each image\with an initial object model 

20 and an initial tracking function. 

32. The computer-implemented process of clair^i 31 wherein the initial 
object model is iteratively replaced with the learned color-b^sed object model 
and the initial tracking function is replaced with a color-basedtracking function to 

25 improve the accuracy of the learned color-based object model\ 

33. The computer-implemented process of claim 1 5 furrier comprising 
a process for gathering the sequential images. 

30 34. A computer-readable memory for identifying the configuration of 

objects of interest in a scene, comprising: 
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a compuW-readable storage medium; and 
-a computer program comprising program modules stored in the 
storage medium, wherein\the storage medium is so configured by the computer 
program that it causes the computer to, 

generate^an initial configuration estimate for objects of 
interest within the scene, 

identify pixe| color information within the scene that is 
relevant to a learned color-basecKobject model, 

automatically learn the color-based object model by 
determining probabilistic relationships between the initial configuration estimates 
and the pixel color information, and, 

generate a final configuration estimate for objects of interest 
in the scene by using the color-based object model in combination with a color- 
based tracking function. 



35. The computer-readable memory of claim 34 wherein the program 
module for generating the initial configuration estimate further includes an initial 
object model and an initial tracking function, and wherein the initial object model 
is comprised of parameters used by the initial tracking function for determining 
the configuration of objects within the scene. 



36. The computer-readable memory of claim 35 wherein the pixel color 
information is represented using a probability distribution function modeled by a 
first Dirichlet function. 



37. The computer-readable memory of claim 36 further comprising a 
background image representing the scene, and wherein theVackground image is 
represented using a probability distribution function modeled bjy a second 
Dirichlet function. 
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38. The computer-readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model further includes a 
preliminary color-based object model represented by a third Dirichlet for 
establishing a probabilistic baseline to assist in learning the learned color-based 
object model. \ 

\ 

\ 

39. The computer readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model automatically 
scales the first and second Dirichlekfunctions based on expected areas of 
objects of interest in the scene relative to areas of the scene not expected to 
contain objects of interest. 



40. The computer readable memory of claim 38 wherein the program 
module for automatically learning the color^based object model automatically 
uses the third Dirichlet function to weight theVirst and second Dirichlet functions. 

41 . The computer readable memory of^claim 39 wherein the program 
module for automatically learning the color-based\^bject model automatically 
determines the difference between the first and secpnd Dirichlet functions to 
generate the learned color-based object model. 



42. The computer readable memory of claim 40 wherein the program 
module for automatically learning the color-based object model automatically 
determines the difference between the first and second Dirichlet functions to 
generate the learned color-based object model. 



43. The computer-readable memory of claim 41 wherein the learned 
color-based object model is represented using a probability distribution function 
modeled by a fourth Dirichlet function. 
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44. A method for automatically learning a color-based object model for 
use in a color-based tracking system, comprising: 

automatically generating a first Dirichlet function for representing 
probabilistic color ranges of at least one target object in an image; 

automatically generating a second Dirichlet function for 
representing a background oNhe image; and 

automatically subtracting the second Dirichlet function from the first 
Dirichlet function to generate a third Dirichlet function for representing the 
learned color-based object model. 

45. The method of claim 44 further comprising a preliminary color- 
based object model represented by a fourth Dirichlet function. 

46. The method of claim 45 wherein the first and second Dirichlet 
functions are weighted by the fourth Dirichlet function prior to subtracting the 
second Dirichjet function from the first Dirichlet function. 

47. The method of claim 44 wherein the first and second Dirichlet 
functions are scaled in relation to the expected area of objects and areas not 
expected to have objects within the image, respectively, prior to subtracting the 
second Dirichlet function from the first Dirichlet function. 
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